Ridge Regression Estimator: Combining Unbiased and Ordinary Ridge Regression Methods of Estimation
نویسندگان
چکیده
Statistical literature has several methods for coping with multicollinearity. This paper introduces a new shrinkage estimator, called modified unbiased ridge (MUR). This estimator is obtained from unbiased ridge regression (URR) in the same way that ordinary ridge regression (ORR) is obtained from ordinary least squares (OLS). Properties of MUR are derived. Results on its matrix mean squared error (MMSE) are obtained. MUR is compared with ORR and URR in terms of MMSE. These results are illustrated with an example based on data generated by Hoerl and Kennard [8].
منابع مشابه
Generalized Ridge Regression Estimator in Semiparametric Regression Models
In the context of ridge regression, the estimation of ridge (shrinkage) parameter plays an important role in analyzing data. Many efforts have been put to develop skills and methods of computing shrinkage estimators for different full-parametric ridge regression approaches, using eigenvalues. However, the estimation of shrinkage parameter is neglected for semiparametric regression models. The m...
متن کاملPerformance of Ridge Regression Estimator Methods on Small Sample Size by Varying Correlation Coefficients: a Simulation Study
When independent variables have high linear correlation in a multiple linear regression model, we can have wrong analysis. It happens if we do the multiple linear regression analysis based on common Ordinary Least Squares (OLS) method. In this situation, we are suggested to use ridge regression estimator. We conduct some simulation study to compare the performance of ridge regression estimator ...
متن کاملOn almost unbiased ridge logistic estimator for the logistic regression model
Schaefer et al. [15] proposed a ridge logistic estimator in logistic regression model. In this paper a new estimator based on the ridge logistic estimator is introduced in logistic regression model and we call it as almost unbiased ridge logistic estimator. The performance of the new estimator over the ridge logistic estimator and the maximum likelihood estimator in scalar mean squared error cr...
متن کاملPreliminary test almost unbiased ridge estimator in a linear regression model with multivariate Student-t errors
In this paper, the preliminary test almost unbiased ridge estimators of the regression coefficients based on the conflicting Wald (W), Likelihood ratio (LR) and Lagrangian multiplier (LM) tests in a multiple regression model with multivariate Student-t errors are introduced when it is suspected that the regression coefficients may be restricted to a subspace. The bias and quadratic risks of the...
متن کاملTwo-Parameters Fuzzy Ridge Regression with Crisp Input and Fuzzy Output
In this paper a new weighted fuzzy ridge regression method for a given set of crisp input and triangular fuzzy output values is proposed. In this regard, ridge estimator of fuzzy parameters is obtained for regression model and its prediction error is calculated by using the weighted fuzzy norm of crisp ridge coefficients. . To evaluate the proposed regression model, we introduce the fu...
متن کامل